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1.  Introduction 

St.  Louis  University,  under  contract  to  the  Air  Force  Geophysics  Laboratory,  developed  a  oon- 
ditional  climatology  model  for  the  Air  Weather  Service  (AWS) .  This  conditional  climatology  model 
was  used  to  generate  Wind-Dewpoint  Conditional  Climatology  (WDCC)  tables.  The  WDCC  model  is 
ilescribed  by  Martin  (1975).  The  most  obvious  differences  between  the  WDCC  tables  and  traditional 
Wind-Stratified  Conditional  Climatology  (WSCC)  tables  are  as  follows: 

a.  The  use  of  dewpoint  depression  as  a  climatology  stratifier. 

b.  The  WDCC  tables  are  derived  from  a  model,  not  just  data.  A  probability  is  given  for 
every  situation,  even  those  which  most  likely  will  never  occur. 

c.  The  resultant  median  cloud  height  is  given  for  every  initial  condition. 

The  WDCC  tables  were  evaluated  at  Randolph  AFB  by  Det  1,  24th  WS  forecasters.  The  two  evaluation 
periods  were  December  1974  through  January  1975  and  January  1976  through  February  1976.  In  these 
two  evaluations,  the  WDCC  tables  were  inferior  to  the  WSCC  tables.  The  HQ  AWS  staff  recommended 
that  a  more  extensive  evaluation  be  conducted  prior  to  producing  WDCC  tables  for  all  AWS  detachments. 
Compared  with  WSCC  tables,  the  WDCC  tables  are  more  cumbersome  to  use  and  more  expensive  to  produce. 
Therefore,  the  WDCC  tables  must  demonstrate  consistently  superior  skill  to  justify  their  production. 

2.  Evaluation  Description 

USAFETAC  converted  the  St.  Louis  University  WDCC  computer  program  to  run  on  the  USAFETAC  com¬ 
puter.  WDCC  tables  were  produced  at  USAFETAC,  and  sent  to  evaluation  units.  The  eight  weather 
detachments  that  participated  in  the  evaluation  are  given  in  Appendix  C. 

The  WDCC  and  WSCC  forecasts  were  recorded  on  keypunch  coding  forms.  A  description  of  the  data 
format  as  well  as  the  ceiling  and  visibility  categories  is  given  in  Appendix  A. 

The  WSCC  tables  used  at  Kunsan  AB  combine  categories  B  and  C,  and  categories  K  and  L.  Both  the 
WSCC  and  WDCC  were  verified  using  this  five  category  system. 

The  completed  keypunch  coding  forms  were  sent  to  HQ  AWS/DN.  HQ  MAC/AD  keypunched  computer 
cards.  The  Defense  Commercial  Communications  Office  computer  was  used  to  verify  the  WSCC  and  WDCC 
forecasts. 

Occasionally  the  WSCC  tables  cannot  provide  a  forecast  because  the  initial  condition  was  never 
observed  during  the  period  of  record  of  the  tables.  In  such  situations,  an  equal  probability  was 
assigned  to  each  of  the  categories. 

3.  Results 

The  results  are  qiven  in  Appendix  B.  The  Brier  score  (Brier  and  Allen,  1951),  or  P-score, 
ranges  from  0  to  2  with  lower  values  indicating  greater  skill,  given  the  same  climatology.  Con¬ 
ti  ngency  tables  were  developed  by  selecting  the  forecast  category  with  the  highest  probability.  The 
percent  correct,  percent  of  three  or  more  category  busts,  and  prefigurance  of  the  lowest  three 
categories  were  all  derived  from  these  contingency  tables.  Prefigurance  equals  hits  divided  by 
total  occurrences. 

Before  considering  the  results  it  should  be  noted  that  two  errors  were  discovered  in  the 
USAFETAC  WDCC  program  subsequent  to  WDCC  table  production.  First,  observations  with  winds  from 
360  degrees  are  not  included  in  the  Travis  AFB  WDCC  tables.  Second,  with  the  exception  of  the  Fort 
Rucker,  Hurlburt  AFB,  and  Wright-Patterson  AFB  WDCC  tables,  visibilities  below  one  mile  were  some¬ 
times  assigned  to  the  wrong  visibility  category.  These  errors  are  believed  to  have  only  a  minor 
effect  on  the  overall  results. 

There  are  only  minor  differences  in  skill  between  the  WDCC  and  WSCC  tables.  The  WDCC  shows 
small  improvements  in  the  Brier  score  and  percent  of  three  or  more  category  busts.  The  WSCC  is 
slightly  better  in  terms  of  percent  correct  and  the  prefigurance  of  the  three  poorest  weather 
categories.  None  of  these  differences  is  highly  significant. 
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Paired  comparisons  were  made  using  the  results  given  in  Appendix  B.  For  example,  if  the  WDcv 
P-score  for  the  40  entries  in  Appendix  B  is 
X,  is  .00325  and  the  standard  deviation,  S, 
may  be  viewed  as  a  sample  from  a  population 
claim,  the  departure  of  the  sample  mean,  X, 
puting  the  ratio 


where  n  is  the  number  of  data  points  in  the 

Z  = 


At  the  .05  significance  level,  |z|  must  be  >1.96  to  reject  the  claim  that  there  is  no  difference  in 
the  tables.  A  value  of  0.816  corresponds  to  a  significance  level  of  0.42. 

Any  effects  of  the  programming  errors  described  above  can  be  eliminated  by  considering  only 
ceilings  at  all  stations  except  Travis  AFB.  The  t-distribution  tables  should  be  used  since  18 
values  is  considered  a  small  sample  (Panofsky  and  Brier,  1968) .  The  P-score  data  results  in  a  mean 
difference  of  -0.002  and  a  standard  deviation  of  0.022.  The  Fort  Rucker,  Hurlburt  AFB,  and  Wright- 
Patterson  AFB  results  are  unaffected  by  the  previously  mentioned  programming  errors.  Using  the 
P-score  data  and  considering  only  the  ceilings,  |t|  =  0.374.  At  the  .05  significance  level,  |t|  must 
be  >  2.110  to  reject  the  claim  that  there  is  no  difference  in  the  tables. 

The  evaluation  results  indicate  that  there  is  little  difference  in  forecast  skill  between  WDCC 
and  WSCC  tables.  There  is,  therefore,  no  justification  to  recommend  WDCC  as  a  replacement  for  Wscr. 


subtracted  from  the  WSCC  P-score,  the  mean  difference, 
is  .0252.  The  claim  is  that  the  WDCC  and  WSCC  P-score: 
with  a  mean  difference  of  zero.  In  order  to  test  this 
from  a  hypothetical  mean,  N,  may  be  evaluated  by  com- 


Z  =  X  -  N 

s/rr 

sample.  For  the  sample  described  above 
.00325  -  0 


.025 


2/ f  40 


0.816. 
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APPENDIX  A 

EVALUATION  DATA  FORMAT 

CoJ  Description 

1 -2  Month  of  year  (01,  02,...,  12) 

<-4  Day  of  the  month  (01,  02,...,  31) 

5-0  Hour  of  the  day  (2)  (00,  01,...,  23) 

H  Initial  Ceiling  Category  (0  £  A  <  200;  200  <_  B  <  500,  500  C  <  1000,  1000  <  D  <  3000, 

3000  <  E  <  10000,  F  >  10000) 

1 0— 1 S  3  hour  ceiling  forecast  from  the  WSCC  tables.  Use  Col  10  for  the  probability  of  Cat  A, 

Col  11  for  Cat  B,  etc.  The  numbers  in  the  WSCC  tables  must  be  rounded  up  or  down.  For 
example,  70-74  =  7,  75-79  =  8. 

17-22  6  hour  ceiling  forecast  from  WSCC 

24-29  3  hour  ceiling  forecast  from  WDCC 

U-36  6  hour  ceiling  forecast  from  WDCC 

!H  3  hour  ceiling  forecast  issued  by  the  detachment.  Use  the  six  categories  described  above 

rather  than  the  existing  AWS  verification  categories. 

39  6  hour  ceiling  forecast  issued  by  the  detachment. 

41  Ceiling  category  observed  at  initial  forecast  hour  +3. 

42  Ceiling  category  observed  at  initial  forecast  hour  +6. 

44  Initial  visibility  category  (0<J<«j,  S  <  K  <  1,  1  £  L  <  2,  2  <  M  <  3,  3  <  N  <  6,  0  >  6) 

46-51  3  hour  visibility  forecast  from  WSCC 

53-58  6  hour  visibility  forecast  from  WSCC 

60-65  3  hour  visibility  forecast  from  WDCC 

67-72  6  hour  visibility  forecast  from  WDCC 

74  3  hour  visibility  forecast  issued  by  the  detachment 

75  6  hour  visibility  forecast  issued  by  the  detachment 

77  Visibility  category  observed  at  initial  forecast  hour  +3 

78  Visibility  category  observed  at  initial  forecast  hour  +6 
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APPENDIX  C 

DETACHMENTS  TAKING  PART  IN  THE  TEST 


Det 

9, 

5WS, 

5WW,  Ft  Rucker  AIN,  AL 

DC  t 

75, 

3WS , 

5WW,  Hurlburt  AFB  (Eglin  9),  FL 

net 

10, 

30WS 

,  1WW,  Kunsan  AB,  KS 

Dot 

7, 

3WS , 

5WW,  Langley  AFB,  VA 

Det 

15, 

31WS 

,  2WW,  Mildenhall  RAF,  UK 

Det 

*•  r 

31WS, 

2WW,  Ramstein  AFS,  GE 

Det 

•1 

7WW, 

Travis  AFB,  CA 

Det 

15, 

15WS 

,  7WW,  Wright-Patterson  AFB,  OH 
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